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The  Ocramanding  Gerieral,  U.S.  Array  Training  and  Doctrine  Ooitinand  (TRADOC) , 
vrants  to  ensure  that  ocnbat  soldiers  possess  the  neoessaury  skills  to  maximize 
the  effectiveness  of  their  hio^-technology  weapon  systems.  He  has  therein 
directed  the  proponent  schools  to  develop  accelerated  initial-entry  training 
prograras  modeled  eifter  the  successful  Excellence  in  Arraor  (EIA)  program. 
Furthermore,  he  has  urged  the  schools  to  select  for  the  accelerated  programs 
(xily  those  soldiers  have  outstanding  gunnery  and  leadership  potential. 

As  part  of  the  TRADOC-directed  Skills  Selection  and  Sustainment  (S^) 
program,  the  U.S.  Amy  Armor  Center  and  School  is  going  to  include  vadidated 
selection  tests  in  the  EIA  selection  process,  including  aun  S^  test  battery. 
The  S^  selection  tests,  developed  ty  the  U.S.  Amy  Reseauxh  Institute  as  part 
of  Project  A,  inclide  psychonotor,  spatial,  and  leadership  scales  that  have 
previously  been  shewn  to  predict  tank  gunnery  performance  and  Nonccrimissioned 
Officer  potentiail.  The  current  research  aissesses  the  utility  amd  iitpact  of 
the  S^  selection  tests  ais  additioml  selection  criteria  for  the  EIA  program. 

The  research  wais  conducted  by  the  U.S.  Amy  Reseaurch  Institute's  Fort 
Wxjx  Field  tfriit  as  Technical  Advisory  Service  to  TRADOC,  with  the  results 
briefed  to  the  Oorananding  GeneraLL,  U.S.  Amy  Armor  Center  and  School,  in  Sep¬ 
tember  1988.  The  results  show  the  S^  test  to  be  hi^ily  predictive  of  simu¬ 
lated  gunnery  perfomence  and  suggest  that  the  inclusion  of  the  tests  in  the 
EIA  selecticxi  process  would  result  in  soldiers  with  stronger  leadership  and 
gunnery  abilities. 
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ASSESSING  THE  IMPACT  OF  PSYCHCMOK»  AND  LEAEERSHIP  SETECnOI  TESTS  Oti  THE 
EXCRTJfNCE  IN  M99DR  PRXSAM 


EXECUTIVE  SUtMARY 


Requirement: 

As  part  of  the  Skills  Selecticai  emd  Sustainment  (S^)  program,  the  re¬ 
search  evcduated  the  potential  effectiveness  of  spatial,  pQ'chcmotor,  and 
leadership  tests  as  additioral  selection  criteria  for  tlf^  Excellence  in  Armor 
(EIA)  program.  The  EIA  program  identifies  outstanding  initial-entry  soldiers 
and  gives  them  accelerated  training  as  part  of  One  Station  Unit  Training 
(OSUT) . 


Procedure: 

The  S^  predictor  tests  were  administered  to  1,642  OSOT  soldiers  at  the 
Fort  Knox  rec^ition  station.  In  additicxi,  479  19K  (Ml  tank  crewmen)  OSUT 
soldiers  were  given  a  35-engagement  tamk  gunnery  te^  on  the  hi(^-fidelity 
Institutional  Conduct  of  Fire  Trainer  (I-COFT) .  The  I-OOFT  test  included 
offensive  and  defensive  engagements  fired  in  normal  and  degraded  operational 
modes.  The  primary  analysis  evaluated  I-OOFT  speed  and  accuracy  as  a  function 
of  S^  spatial/psychoraotor  scores.  Additioneil  analyses  compared  the  S^  test 
scores  of  soldiers  currently  selected  for  EIA  to  those  net  selected  and  exam¬ 
ined  hew  S^-based  selections  would  differ  from  current  procedures. 


Findings: 

The  spatial/psychorootor  tests  were  a  streng  predictor  of  simulated 
tank  gunnery  performance,  yielding  a  correlation  of  .54  with  I-COFT  speech 
accuracy.  The  2-1/2-inQnth  interval  between  the  predictor  and  criterion  tests 
suggests  that  the  relationship  should  remain  stable  over  time.  P\jrthermore, 
the  strength  of  the  relationship  shrank  only  sli^tly  vhen  the  EIA  soldiers 
were  given  ccxTsiderable  additionea  training.  Soldiers  currently  selected  for 
EIA  scored  hic^ier  cxi  edl  of  the  predictor  tests  euid  on  the  I-OOFT  criterion 
tests  than  soldiers  not  selected.  Only  a  moderate  overlap  was  found,  however, 
between  the  current  selection  procedures  and  -based  selecticxis.  The  results 
indicate  that  including  the  tests  in  tte  EIA  selection  process  would  result 
in  EIA  graduates  with  strenger  gunnery  skills. 
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utilization  of  Findings: 

The  results  are  being  losed  by  the  IKADOC  D^juty  Qiief  of  Staff  for  Train¬ 
ing  (DCST) ,  U.S.  Anty  Training  and  Docrtrine  Ccnmand,  and  the  Ocrinanding  Gen¬ 
eral,  U.S.  Arny  Armor  Center  and  ScJiool,  to  inprove  the  selecticxi  criteria  and 
thereby  the  quality  of  the  graduates  of  the  EEA  program  and  other  accelerated 
initial-entry  programs. 
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ASSESSING  TOE  IMPACT  CF  PSYCHCMOTOR  AND  LEADERSHIP  SELBCTIC*^ 
TESTS  CM  TOE  EXCELLENCE  IN  ARMOR  PROGRAM 


Introduction 

Success  on  the  modem  battlefield  requires  soldiers  v>tio  cein  naximize  the 
performance  of  their  veapon  systems  and  vho  are  also  excellent  leaders.  lb 
help  meet  these  needs,  the  U.S.  Army  Armor  Center  (USAARMC)  in  1984  initiated 
the  Excellence  in  Armor  (EIA)  program  as  a  ocmplement  to  armor  initial-entry 
training.  The  EIA  program  identifies  early-on  in  cne  Station  Unit  'Hraining 
(OSUT)  high-quality,  motivated  soldiers.  TOe  selected  soldiers  receive  ac¬ 
celerated  tredning  on  hard-skill  armor  tasks,  with  successful  perfomance 
resulting  in  early  promotions.  Ihe  goals  of  the  EIA  program  include  increased 
retention  of  high-quality  enlisted  personnel  and  accelerated  progression  of 
EIA  graduates  into  tank  aomander  (TC)  assignments.  Fbr  a  more  detailed 
description  of  the  program  eind  EIA  selection  procedures,  refer  to  the  USAARMC 
report  on  CMF  19  Active  Odmponent  Personnel  Assessment  (1985). 

Similcirly,  the  Ocmnanding  General,  U.S.  Army  Trcdning  cind  Doctrine 
Goitrand  (TRADOC)  vants  to  ensure  that  the  highest  quality  soldiers  are 
fighting  and  maintaining  the  high-tech  weapon  systems  in  the  Amy  inventory. 
Eased  on  this  desire  and  the  success  of  the  EIA  program,  he  has  directed  the 
proponent  schools  to  implement  accelerated  initial-entry  training  programs 
modeled  after  EIA.  He  has  further  urged  the  schools  to  base  the  programs  on 
the  selection  of  individuals  with  outstanding  abilities  to  perform  gunnery 
tasks.  Together  with  the  development  of  comprehensive  device-based  prescrip¬ 
tive  training  strategies,  the  programs  are  being  called  Skills  Selection  and 
Sustainment  (S3). 

Reports  from  field  oommanders  indicate  the  EIA  program  is  presently 
successful,  in  that  EIA  graduates  cure  superior  to  other  OSUT  graduates.  As 
part  of  continuing  efforts  to  improve  the  eunror  force,  USAARMC  is,  however, 
interested  in  enhancing  the  quality  of  its  EIA  graduates  through  improved  EIA 
selection.  Ihe  reseeurch  reported  here  examines  a  new  set  of  predictor  tests, 
with  potential  application  for  selecticn  into  EIA.  Ihe  s3  selection  tests 
were  developed  by  the  U.S.  Army  Researcdi  Institute  in  an  effort  to  assess 
spatial,  psychcmotor,  end  leadership  abilities.  Shcxild  the  implementation  of 
the  s3  selection  tests  prove  effective,  the  result  would  be  an  EIA  graduate 
population  with  even  greater  leadership  emd  warfighting  potential. 

Previous  research  has  shown  the  s3  tests  to  be  strong  preoiicrtors  of  armor 
performance,  including  tank  gunnery  and  pero:eived  NOO  potential,  ardth  and 
Graham  (1987)  found  a  multiple  onrrelation  of  .76  between  an  s3  test  battery 
and  performance  on  the  Unit-Conduort  of  Fire  Itainer  (U-CDFT).  TOe  validation 
was  oxnducted  with  soldiers  enrolled  in  the  Armor  Officer  Basic  Cburse.  As 
for  prediorting  leadership  ability,  Gast  (1988)  found  that  the  EIA  graduates 
vho  scxjred  high  on  the  test  battery  were  likewise  rated  higher  by  both  peers 
and  supervisors  on  technical  and  leadership  abilities.  Ihe  s3  test  battery 
thereby  selected  the  "cream  of  the  crop"  within  EIA. 
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purpose  of  Researdi 

Hie  purpose  of  the  research  was  to  assess  the  utility  and  impact  of  the 
s3  predictors  tests  as  additional  selection  criteria  for  the  EIA  program.  Ihe 
major  questions  addressed  were; 

1.  Do  tests  predicc  simulated  tank  gunnery  performance? 

2.  Do  soldiers  currently  selected  for  EIA  differ  in  s3  predictor 
test  scores  frcm  those  not  selected^ 

3.  How  closely  would  S^-based  selections  correspond  with  current 
selections? 


Ttest  Materials 

The  selection  battery  included  two  paper-eind-pencil  tests,  the  orienta¬ 
tion  test  and  maze  test,  and  two  ccnputerized  tracking  tests.  In  addition, 
the  battery  included  the  Assessment  of  Background  and  Life  Experiences  (ABLE) 
test.  A  tank  gunnery  criterion  test  was  developed  and  administered  using  the 
Institutional-Ckonduct  of  Fire  Trainer  (I-COFT),  a  hi^-fidelity  tank  gunnery 
simulator.  A  description  of  the  tests  and  test  devices  is  provided  below. 

Orientation  Ttest 


The  orientaticn  test  is  a  paper~and-pencil  spatial  abilities  test  designed 
to  measure  one's  ability  to  visualize  an  object  When  it  is  mentally  rotated. 
Etech  item  presents  a  rotated  picture  within  a  frame,  with  a  circle  and  a  dot 
at  the  botton  of  the  frame.  The  soldier's  ta^  is  to  mentally  rotate  the 
frame  so  that  the  circle  is  positioned  at  the  botton  of  the  picture.  Because 
the  dot  within  the  circle  also  rotates,  the  soldier  must  decide  how  the  dot 
would  look  in  relaticn  to  the  circle  if  the  frame  were  rotated.  Five  respon¬ 
ses  are  provided  for  each  of  the  24  items.  Figure  1  shews  a  sample  item  with 
alternative  "B"  being  the  correct  response.  The  test  is  thought  to  predict 
success  in  maintaining  position  relative  to  environmental  landmarks  including 
conditions  of  frequent  direction  changes  (Peterson,  1987). 
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Nbze  "Itest 


Ihe  naze  test  is  a  paper-and-pencil  test  designed  to  measure  additicxial 
spatial  abilities,  namely  spatial  scanning.  Spatial  scanning  refers  to  the 
ability  to  scan  a  ocnplex  visual  field  and  to  identify  particular  patterns  or 
pathways  within  the  field.  Figure  2  shews  a  sanple  item  frem  the  maze  test; 
alternative  "B"  is  the  correct  answer.  Each  of  the  24  items  consists  of  a 
rectangular  maze  with  four  entrances  amd  severed  exits.  Ihe  soldier  must 
identify  the  cne  eitrance  vhich  leads  to  an  exit.  Ihe  maze  test  is  thought  to 
predict  success  in  using  maps  in  the  field  end  in  perfonrance  of  electronic 
operations  (Petersen,  1987). 

MAZE  TEST 


©  @  ©  © 

Figure  2.  Semple  item  from  the  maze  test. 

*Iiacking  Tests 

The  two  tracking  tests  require  the  soldier  to  view  a  oerputer  screen  and 
to  use  the  specially  designed  response  pedestal  shewn  in  Figure  3.  Ihe  two 
pursuit  tracking  tests  are  visually  the  same  with  the  difference  being  in  the 
way  the  soldier  controls  movement.  In  the  first  test  the  soldier  uses  either 
the  right  or  left  joystick,  depending  cn  handedness.  In  the  second  test  the 
soldier  uses  the  horizontal  and  vertical  slide  resistors. 


Figure  3.  Response  pedestal  used  in  oemputerized  tracking  tasks. 
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R)r  each  item  as  shcvm  in  Figijre  4,  the  soldier  sees  a  path  of  horizontal 
and  vertical  line  segments  vdth  a  target  box  at  one  end.  The  target  box 
moves  alorig  the  path  at  a  constant  speed.  The  soldiers 's  task  is  to  manipu¬ 
late  the  joystick  (or  horizcaital  and  vertical  slides)  to  keep  the  crosshairs 
in  the  center  of  the  box.  Across  trials  the  speed  of  the  target  and  the 
ocmplexity  of  the  path  varies.  The  tracking  tests  were  designed  to  assess 
fine  motor  control  and  multilimb  coordination. 


Figure  4.  Representative  screen  for  a  tracking  item. 

ABLE  Ibst 

ABLE  is  a  tenperament  and  biodata  battery  designed  to  supplement  the 
ASVAB.  Research  evidence  shews  that  soldiers  vtho  score  hi^  cn  ABLE  exhibit 
greater  effort,  discipline,  fitness,  and  the  likelihood  of  catpleting  their 
first  tour.  The  ABLE  short  form  used  in  this  research  contained  87  multiple 
choice  items  selected  frem  four  content  scales  and  two  response  validity 
scales.  Ihe  content  scales  were  Dcminance,  Work  Orientation,  Non-Delinquency, 
and  Emotional  Stability  with  the  response  validity  scales  being  Non-Random 
Responses  and  Unlikely  Virtues. 

I-COFT 


I-COFT  Description.  The  I-COET  is  a  high-fidelity  tank  gunnery  simulator 
which  has  become  a  central  oonponent  in  the  suite  of  armor  gunnery  training 
devices.  Recently  the  I-CX)FT  has  begun  to  be  used  as  a  research  device  for 
measuring  teuik  gunnery  proficiency.  TC  and  gunner  ocxitrols  on  the  Ml  I-COET 
are  viirtually  identiceil  to  those  in  the  actual  tank,  making  the  I-CQFT  anal¬ 
ogous  to  flight  simulators  used  in  military  and  ocnmercial  training.  The 
I-COFT  simulates  tank  optics  with  computer-generated  imagery  and  can  be  used 
as  either  a  vhole-task  or  part-task  trainer.  In  additicxi,  I-COET  tests  can  be 
constructed  to  measure  a  full  rauige  of  target  engagement  tasks,  including 
target  acquisiticxi,  laying  the  main  gun,  and  issuing  fire  oenmands. 

Device-mediated  tests  with  the  I-OOFT  offer  certain  advantages  over  other 
hands-on  perfomance  tests.  Ihese  pluses  include  standardized  administration 
and  scoring,  emd  the  capability  of  inexpensively  building  Icxiger  tests  with 
varied  target  ccaiditions.  Research  evaluating  the  reliability  of  testing  cn 
the  Unit-CcxKluct  of  Fire  Trainer  (U-COFT)  has  found  test-retest  reliability 
coefficients  vhich  exceed  .80  (Graham,  1986).  Ihe  I-COET  and  U-COET  are 
essentially  the  same  with  the  exception  that  the  I-OOFT  includes  softwcure 
options  v»hich  can  present  peurt-task  training.  Other  desirable  cheuracteristics 
of  I-OOFT  tests  eire  that  they  can  be  used  to  separate  the  ccxitributions  on 
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individxial  cxewnen  in  tank  gunnery  engageannents  and  can  be  safely  administered 
to  novice  crevjnen. 


Test  Qbnstmcticn.  Ihe  I-COFT  gunner's  test  develc^sed  for  this  research 
contained  four  exercises  taken  from  the  I-COFT 's  I&rget  fhgagement  Practice 
Exercises  (TEPE).  Ihe  exercises  were  selected  with  the  cissistance  of  the 
Armor  Simulator  Divisiai,  Weapons  Department,  U.S.  Anty  Armor  School 
(USAARMS).  Ihe  selected  exercises  inclixied  offensive  and  defensive  engage¬ 
ments  fired  with  daylight  and  thermal  sights  under  normal  and  degraded 
operational  conditions.  Ihe  selection  of  the  exercises  vas  constrained  such 
that  the  OSUT  soldiers  had  to  have  been  trained  cn  the  tested  oonditiois. 
I&ble  1  shews  the  exercises  included  in  the  test  in  the  order  of  test  presen¬ 
tation. 

I&ble  1 

I-COFT  Test  Ehgaganent  Oonditions 


I-COFT 

Exercise 

Number 

Nurber 

of 

Ihrgets 

Own 

Vehicle 

Ihrgets 

Fire 

Oontrol 

Malfuncticxis 

31271 

10 

Staticxiary 

Short  Range 

Stationary 

Handles 

Primary  Sight, 
Bower  Oontrol 

32511 

5 

Moving 

long  Range 
Moving 

None 

32241 

10 

Stationary 

Long  Range 
Stationary 

Stabilization 

System 

32321 

10 

Stationary 

long  Range 
Moving 

None 

Ihe  one  hour 

test  required  all  targets 

to  be  engaged  with 

the  main  gtan. 

Ihe  test  cilso  ertployed  the  I-COFT 's  synthetic  TC,  an  instructicxial  feature 
vhereby  the  software  automatically  acquires  targets,  lays  the  main  gun,  and 
gives  fire  oonmands.  Ihe  synthetic  TC,  in  effect,  simulates  a  perfect  TC  in 
that  it  always  gives  correct  fire  cermands  and  consistent  target  acquisition. 
All  OSUT  I-COFT  gunnery  training  uses  the  synthetic  TC,  in  part,  because  it 
eliminates  the  support  requirement  for  a  TC.  For  tank  gunner  testing  pur¬ 
poses,  the  synthetic  TC  is  ideal  in  that  it  helps  ensure  standcurdized  testing. 

Performance  Meeisures.  IWo  perfomance  measures  were  obtained  from  each 
exercise;  percent  hits  and  opening  time.  Percent  hits  was  sinply  the  number 
of  targets  hit  divided  by  the  number  of  targets  presented.  Cpening  time 
measured  the  amount  of  time  frem  vdien  a  target  appeared  until  the  first  round 
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vEis  fired.  Rsr  engagements  In  ^diich  no  rounds  Mere  fired,  an  opening  time  of 
30  seconds  was  assigned,  the  maximum  I-OQFT  opening  time  possible  for  the 
selected  exercises.  While  there  are  situations  in  battle  vhere  it  is  ad- 
vemtageous  not  to  fire,  failure  to  fire  at  I-OOFT  targets  was,  by  definition, 
an  error.  Assigning  the  maximun  opening  time  vhen  the  gunner  did  not  fire 
gave  a  poor  score  for  poor  performance. 

A  total  percent  hits  and  meein  opening  time  were  ocnoputed  by  taking  the 
mean  of  the  means  for  each  of  the  exercises.  This  procedure  resulted  in  an 
equal  weighting  of  the  exercises,  even  though  the  offensive  exercise  (cwntank 
moving)  had  fewer  targets.  A  speed/accuracy  ccnposite  score  ves  also  ocnputed 
by  svabtracting  the  standardized  opening  time  from  the  standardized  percent 
hits.  The  opening  times  were  subtracted  because  lower  times,  i.e.,  faster 
opening  times,  represent  better  performance.  The  speed/accuracy  conposites 
were  then  transformed  into  t-soores,  giving  the  speed/accuracy  scores  a  mean 
of  50  and  a  standard  deviaticxi  of  10. 

Method 


Participants 

Four  hundred  seventy-nine  19K  (Ml  tank  crevman)  OSUT  soldiers  ocnpleted 
both  the  predictor  battery  and  the  I-<30FT  gunnery  criterion  test.  The 
soldiers  were  from  five  training  oonpanies  of  the  1st  Anrored  Training  Brigade 
(lATB),  Fort  Knox,  KY.  Predictor  scores  were  also  obtained  from  an  addition¬ 
al  1143  OSUT  soldiers,  including  MOSs  19D  (scouts)  and  19E  (M60  tank  crevinan) , 
fca:  a  total  of  1642. 

Procedure 

The  soldiers  took  the  predictor  tests  at  the  Fbrt  Knox  Recepti<x;  Station 
on  the  third  day  of  their  ini  tied,  processing  into  the  Army.  The  tests  were 
administered  by  a  oontracted  testing  service  between  February  and  June  1988. 
The  order  of  the  tests  was  varied  to  maximize  the  use  of  the  ocnputers.  The 
orientation  test  and  maze  tests  had  time  limits  of  10  minutes  and  5  1/2 
minutes,  respectively.  The  ocrtputer  tracking  tests  and  ABLE  were  self-paced, 
but  usually  took  less  than  20  minutes  each.  The  entire  testing  session 
including  instructicxis  and  breaks  took  around  one  cind  a  hcilf  hours. 

For  the  19K  soldiers  only,  I-COFT  tests  were  administered  by  1-COFT 
Instructor/Cperators  (I/O)  during  the  last  (or  20th)  hour  of  OSUT  I-CXJFT 
training;  this  fell  in  the  tenth  week  of  OSUT  training.  Because  the  test  was 
givai  the  second  hour  of  a  two-hour  block,  no  warm-vp  was  deemed  necessary. 
Prior  to  the  initial  testing  session,  the  I/O’s  were  explained  the  purpose  of 
the  project  and  that  they  should  not  provide  assistance  to  the  soldiers  once 
the  test  exercises  began.  The  I-COFT  tests  were  administered  between  April 
and  August  1988. 

The  19K  soldiers  selected  for  the  ElA  program  received  an  additicxial  14 
hours  of  I-GOFT  training.  These  soldiers  were  readministered  the  I-OQFT  test 
at  the  end  of  this  training.  The  additional  training  and  the  I-COFT  retest 
normally  occurred  within  a  week  and  a  half  of  the  initial  I-OOFT  test. 
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Because  of  data  collection  prctolems,  EUA  retest  data  were  cnly  collected  frcm 
three  OSUT  ccnpanies.  Porty-two  soldiers  vsere  given  the  retest,  of  v^ian  only 
40  had  taken  the  first  test. 

Performance  Measures 


Ihe  following  variables  were  used  in  the  analyses.  A  brief  description 
is  presented  on  hew  each  was  gathered,  calculated,  or  derived. 

Spatial  Test  Score.  The  score  was  the  number  of  correct  responses  from 
the  48  items  on  the  orientation  and  maze  tsts  added  together  and  expressed  as 
a  standcird  score.  Ihe  scailing  was  referenced  to  3000t  trainees  from  combat 
MDSs  in  the  Project  A  ccncurrent  validation  (Cairpbell,  1988) . 

Tracking  Ttest  Score.  The  tracking  score  was  based  cn  the  mean  log 
distance  the  cursor  was  frcm  the  center  of  the  target,  averaged  across  time 
and  trials.  Item  scores  for  one-  and  two-  hand  tracking  were  surtmed  and 
standardized  to  the  norms  of  the  Project  A  concurrent  validation. 

Spatial/Psychcmotor  Oarposite  .  Scores  from  the  spatial  and  tracking 
tests  were  weighted  equally  to  form  a  oemposite  percentile  score.  The  norms 
were  based  on  the  performance  of  enlisted  soldiers  frcm  a  nuiiber  of  oaiibat 
MOSs,  i.e.,  the  norms  do  not  represent  tankers  (CMF  19)  alone. 

ABLE  Score.  The  ABLE  scores,  as  with  the  spatial/psychcmotor  oerposite, 
represented  percentiles  based  on  norms  of  soldiers  in  oerbat  MOSs  from  the 
concurrent  validation  of  Project  A. 

GT  Score.  The  General  Technical  (GT)  score  frcm  the  Armed  Services  Voca¬ 
tional  Aptitude  Battery  (ASVAB)  was  obtained  from  personnel  records  in  the 
training  brigade  headquarters.  The  GT  scores  were  used  as  a  measure  of  mental 
ability. 

I-COFT  Training  Perfortiance.  During  the  20  hours  of  I-COFT  training  in 
19K  OSUT,  the  soldiers  typically  received  16  Task  Tlraining  Exercises.  Each  of 
these  were  scored  Go/Nd  Go  by  the  I-OOFT.  The  I-CDFT  Training  Performance 
score  indicated  the  percent  GOs  on  these  exercises.  The  scores  ranged  from 
about  50%  to  94%. 

EIA  Selecticxi  Status.  This  measure  indicated  whether  the  soldier  was 
selected  for  EIA  or  not. 

EIA  Graduatican  Status.  This  measure  indicated  whether  the  soldier 
graduated  from  EIA  or  not. 

Percent  Hits.  This  I-COFT  measure  indicated  the  percent  of  targets  hit 
out  of  the  35  presented  on  the  I-COFT  test. 

Opening  Times.  Opening  Time  reflected  the  mean  amount  of  time  the 
soldier  required  to  fire  the  first  round  cn  each  I-COET  engagement. 


7 


S^aeed/Accuracy  Oorposite.  Percent  hits  and  opening  times  were  cxambined 
into  a  speed/accuracy  cmposite  vhich  vas  converted  into  a  t-soore.  The 
speed/accuracy  ocnposite  was  used  as  the  primary  I -COPT  performance  measure. 

Results 

Etedicticxi  of  I-CQFT 


Performance  cn  the  s3  predictor  battery  was  highly  correlated  with 
I-OOFT  gunnery  performance,  l^le  2  shews  the  correlation  coefficients 
between  the  spatial /psychemotor  ocirposite  and  I-COPT  hits,  opening  times 
and  the  speed  accuracy  oenposite.  The  negative  correlation  of  opening  times 
with  the  ^atial/psychcmotor  oenposite  indicates  that  soldiers  with  higher 
spatial/psychorotor  scores  were  faster,  i.e.,  they  had  shorter  opening  times. 

Table  2 

Correlations  of  Spatiad/Psychemotor  Gbirposite  Scores  with  I-COFT 
Performance  Measures 


I-OOFT 

Measure  (n  =  479) 

r 

Percent  Hits 

.48* 

Opening  Times 

-.52* 

Speed/Accuracy  Qomposite 

.54* 

*p  <  .0001 


Ihe  soldiers  were  then  split  into  three  equal  sized  groups  as  a  functicxi 
of  their  spatial/psychortotor  composite  score.  Figure  5  shows  I-OCfT  percent 
hits  for  the  lower,  middle,  and  ipper  spatial /psychomotor  groups.  An  Analysis 
of  Variance  (ANOVA)  found  the  differences  in  means  to  be  significant  with 
F(2,476)  =  51.9,  p  <  .0001. 

Similarly,  Ifeible  3  shows  the  mean  opening  times  and  ^)eed/accuracy  com¬ 
posites  for  the  three  groups  split  on  spatial/psychomotor  corposite.  Given 
that  the  speed/accuracy  corposite  are  t-scores  with  a  mean  of  50  and  standard 
deviation  of  10,  the  difference  between  the  lower  and  upper  grotps  is  greater 
than  one  standard  deviation.  Similarly,  the  difference  between  the  ipper  and 
lower  groups  for  mean  percent  hits  emd  opening  times  were  also  greater  than 
one  standard  deviation. 
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Spatial/Psychomotor  Groups 

Figure  5.  Percent  hits  for  the  Icwer,  middle,  and  t^jper  spatial/psychcrDtor 
oarposite  groups. 

Table  3 

Opening  Times  and  Speed/Accuracy  0t«posites  for  the  Lower,  Middle,  and  lp>per 
Spatial /Psychomotor  Gctrposite  Groups 


Spatial/ 

PsychonotuDr 

Group 

Opening 

Time  (secs) 

(s.d.  =  2.5) 

^5eed/ 

Accuracy 
(s.d.  =  10) 

lower  1/3 

20.0 

43.5 

Middle  1/3 

18.0 

51.5 

Ipper  1/3 

17.2 

55.1 

F{2,476)  = 

62.2* 

68.2* 

*p  <  .0001 


70% 
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The  results  shew  that  soldiers  vdxj  scored  higher  cn  the  s3  spatial/ 
psychomotor  tests  were  ocxisiderably  more  accurate  emd  faster  on  the  I-OOFT 
gunnery  test  them  those  soldiers  vho  scored  Icwer.  The  2  1/2  month  time  span 
between  the  predictor  test  battery  and  the  I-OOFT  gunnery  test  suggests  the 
relationship  is  valid  over  extended  periods  of  time.  The  results  corroborate 
those  of  anith  and  Graham  (1987)  in  shewing  the  spatial/psychcirotor  tests 
to  be  valid  predictors  of  tank  gunnery  performance  as  measured  on  the  1-OOFT. 

Regression  Analyses 

A  series  of  regression  analyses  vere  conducted  to  predict  I-COFT  perfor¬ 
mance  fran  scores  and  other  available  information.  Bor  each  of  the 
regressicxi  analyses,  the  criterion  measure  was  I-OOFT  speed/accuracy.  Thble  4 
shows  the  zero-order  oorrelaticais  of  the  predictors  with  the  I-COFT  conposite. 

Tbble  4 

Zero-order  Correlations  of  Predictor  Scores  with  1-CQFT  ^jeed/Accuracy 
Cemposite 


Predictor  (n  =  446)  r 


Spatial/psychomotor  cemposite 

.54 

I-OOFT  training  score 

.48 

Tracking  test  score 

•46 

Spatial  test  score 

.40 

GT  score 

.34 

ABLE 

.11 

The  results  of  the  first  stepwise  regression  analysis  in  vhich  all 
predictors  vvere  eligible  for  inclusion  are  shewn  in  Table  5.  As  is  typically 
the  case  in  stepwise  regressicxi  analyses,  variables  are  added  only  when  they 
significcintly  contribute  to  the  prediction  of  the  critericxi  (p  <  .05). 

These  data  shew  that  I-OOFT  test  performance  is  best  predicted  by  a 
combination  of  test  scores  and  I-COFT  training  performance  data.  Even 
thou^  the  two  variables  are  moderately  correlated  (.53),  they  independently 
contribute  to  the  predictiOT  of  the  I-COFT  test.  It  is  semevhat  surprising 
and  encouraging  that  the  spatial/peychomotor  cemposite  correlates  more  highly 
with  the  I-COFT  test  than  does  the  I-COFT  trainijig  performance.  The  s3  tests 
may  be  the  better  predictor  of  the  I-OOFT  test  because  of  similar  performance 
pressures  in  both  the  predictor  and  criterion  testing  situaticxis. 
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I&ble  5 


Stepwise  Regressicx^  of  I-COPT  ^)eed/Accuracy  -  All  Veiriables  Included 


Predictor 


Multiple 

Beta  R 


Multiple 

r2 


Step  1 

Spatial/psychcrotor 

cxxnposite 

.54 

.54 

.29 

Step  2 

Spatial  / psychomotor 
oerposite 

.39 

.59 

.35 

I-COFT  treiining  score 

.29 

A  second  regressiai  analysis  examined  the  incremental  validity  of  s3 
tests  atxjve  GT,  a  readily  available  ASVAB  score.  Ibble  6  shows  a  stepwise 
regression  after  GT  was  forced  in  as  the  first  step. 

Table  6 

Multiple  Regression  cn  I-COFT  Speed/Accuracy  -  GT  Ehtered  First 


Predierbor 

Beta 

Multiple 

R 

Multiple 

r2 

Step  1 

GT 

.34 

.34 

.11 

Step  2 

GT 

.11 

.55 

.30 

Spatlal/psychcmotor 

.43 

ccmposite 


This  analysis  shews  that  while  mental  ability,  i.e.,  GT  score,  is  related 
to  the  I-CQFT  perfornance,  gunnery  performancre  is  more  a  function  of  spatial 
and  psychomotor  skills  than  of  mental  ability.  For  a  more  ocmplete  descrip¬ 
tion  of  how  mental  ability  is  related  to  these  I-COFT  test  scores,  refer  to 
Graham  (in  prep). 

Ihble  7  shews  the  results  of  a  regression  analysis  using  predictors  other 
them  the  s3  tests,  ramely  GT  emd  I-COFT  training  sexsres.  These  data  shew  that 
a  cernbinatien  of  I-OOFT  training  soor^  and  GT  does  nearly  as  good  of  a  job  of 
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predicting  I-COFT  perfomance  as  the  s3  tests.  I-COFT  treiining  performance 
data  is,  hcwever,  only  available  for  19K  OSUT  soldiers. 

Table  7 

Multiple  Regression  cn  I-COFT  Speed/Accuracy  -  s3  ft-edictors  Occluded 


Predichuor 

Beta 

Multiple 

R 

Multiple 

r2 

Step  1 

I-COFT  training  score 

.48 

.48 

.23 

Step  2 

I-COPT  training  score 

.43 

.52 

.27 

GT 

.18 

Analyses  Fbllcyndng  Additional  EIA  I-COFT  liaining 


As  discussed  above,  soldiers  selected  for  EIA  received  an  additional  14 
hours  of  I-COFT  training  as  part  of  the  EIA  accelerated  training.  Ihe 
following  analyses  examined  the  effects  of  the  additional  training  on  I-OOFT 
test  performance  and  also  cn  the  predictive  validity  of  the  tests  after  the 
additional  training.  Tbble  8  shews  I-COFT  performanc®  oefore  and  after  the 
additional  14  hours  of  training  for  the  40  soldiers  v»ho  took  both  tests.  Not 
surprisingly,  the  additicnal  hours  of  I-COFT  training  led  to  a  marked  iitprove- 
ment  in  gunnery  performance,  both  in  terms  of  speed  and  accuracy. 

The  EIA  retest  analyses  included  a  highly  selecrted  group  of  soldiers  vho 
performed  cxxisiderably  better  than  the  vthole  OSUT  class.  For  exaitple,  the 
overall  mean  percent  hits  cn  the  original  test  was  .63,  as  ocnpared  to  the  EIA 
mean  of  .71.  For  oomparison,  the  overall  mean  opening  time  ves  18.4  seconds, 
eind  the  mean  speed/acxnracy  cxrposite  was,  ty  definition,  50. 

Figure  6  shows  the  mean  opening  times  for  the  EIA  soldiers  separated  into 
lower,  middle,  eind  i^per  spatial/psychcnotor  composite  groups.  The  cut 
scx>res  for  the  three  groups  were  the  same  as  those  used  in  the  earlier  ana¬ 
lyses.  Separate  ANDVAs  found  significant  differences  both  before  the  addi¬ 
tional  hours  of  training,  F(2, 37)  =  3.53,  p  <  .05,  and  after  F(2,39)  =  3.23, 
p  <  .05.  For  the  before  training  ANOVA,  the  n's  were  9,  14,  and  17. 


12 


lahle  8 


I-COFT  Performance  Measures  Before  and  After  Additional  14  Iburs  of 
Training 


I-COFT 

Measure  (n  =  40) 

Before 

After 

t(39)= 

Percent  Hits 

.71 

.84 

5.37* 

Opening  Times  (secs) 

17.2 

14.4 

9.02* 

Speed/Accuracy  Cbmposite 

55.7 

65.8 

7.72* 

*p  <  .0001 


Lower  1/3  (n-9)  Middle  1/3  (n-15)  Upper  1/3  (n-18) 

Spatial/Psychomotor  Groups 


Figure  6.  EIA  opening  times  before  and  after  the  additional  training. 

These  data  show  significant  differences  in  I-COFT  speed  for  the  Icwer, 
middle,  and  i?^r  ^Htial/psychonotor  ocnposite  groups  both  before  and  after 
additional  training.  Significant  differences  were  rx3t,  hcwever,  found  for 
percent  hits  after  the  additicxial  training,  v>hich  was  likely  due  to  a  ceiling 
effect.  The  point  here  is  that  the  s3  tests  are  predictive  of  I-COFT  perfor¬ 
mance  at  two  different  levels  of  training.  A  similar  finding  is  that  the 
tracking  best  correlated  with  I-COFT  speed/accuracy  .37  before  the  training 
and  .35  after  the  additional  training.  These  correlations  are  lower  than 
those  found  for  the  entire  OSUT  sample  because  of  restricted  range,  i.e.,  the 
EIA  soldiers  were  generally  from  the  top  of  the  distribution. 
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Ihe  differences  shewn  in  figure  6  are  perhaps  best  interpreted  in  terms 
of  effect  size,  as  urged  by  pre^nents  of  meta-analysis,  e.g.,  Glciss  (1977). 
Effect  size  reflects  the  nagnitude  of  differences  between  groups  in  terms  of 
standard  deviation  units.  Oonsider  then  the  differences  relative  to  the  2.5 
second  I-COPT  opening  time  standeurd  deviation  for  the  OSUT  sairple.  The  14 
hours  of  additicned  training  lead  to  an  improvement  of  over  one  standard 
deviation.  The  difference  between  the  lower  and  ipper  s3  groups  renained 
about  .5  standard  deviations  both  before  and  after  treiining.  The  latter 
figure  is  prcisably  underestimated  in  that  the  standard  deviation  for  opening 
times  CXI  the  retest  was  1.7  seconds.  Using  1.7  as  the  base  of  oerparison 
means,  the  effect  size  between  the  tpper  and  lower  groups  after  training  v^as 
.82.  An  effect  size  of  1.0  is  generally  considered  a  Icirge  effeert  (Cohen, 
1977). 

Test  Scores  of  ELA  and  Normal  Track  Soldiers 

The  current  EIA  selection  process  selects  approximately  11%  of  OSUT 
soldiers  for  the  ELA  program,  primarily  based  on  trainir>g  rerfornance  and 
supervisory  evaluations.  If  the  skills  evaluated  by  the  tests  are  iitpor- 
tant  to  the  EIA  program,  s3  test  differences  should  currently  exist  between 
those  soldiers  selected  and  those  not  selected  for  EIA.  T&ble  9  shews  the 
mean  test  scores  for  soldiers  selected  and  not  selected.  These  ciata 
include  scores  frexn  all  three  armor  MOSs. 

Tahle  9 

Mecin  S3  Tfest  and  GT  Scores  for  Soldiers  Selecrted  and  Not  Selec±.ed  for  EIA 


Test 

Scores 

Selecrted 

(n=182) 

Not  Selecrted 
(n=1459) 

t(1639)= 

Spatial  test 

34.4 

30.5 

5.34* 

Tracking  test 

56.8 

53.4 

5.11* 

Spatial/psychcmotor  cxxrposite 

72.1 

59.1 

6.29* 

ABLE 

68.0 

54.2 

5.86* 

GT 

109.2 

103.9 

5.10* 

*p  <  .0001 


These  data  shew  that  those  soldiers  currently  selec:ted  for  EIA  score 
higher  on  the  tests  and  GT  than  those  not  selected.  That  the  dimensions 
cire  ijtportant  to  EIA  is  further  supported  by  a  discriminant  analysis  whicdi 
derived  a  discriminant  functicxi  between  soldiers  selecrted  and  not  selected  for 
EIA.  The  discriminant  cinalysis  Wcis  exonduerted  on  the  19K  soldiers  so  as  to 
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include  I-COFT  training  data,  'feble  10  shews  the  oorrelaticxi  of  the  dis¬ 
criminating  variables  with  the  single  canonical  discriminant  functicxi.  Ihe 
canonical  correlation  was  .24. 

Tbble  10 

Correlations  of  Tfest  Scores  with  Canonical  Discriminant  Functicxi 


Test  Score  (n  =  445)  r 


Spatial  test 

.77 

GT 

.75 

Spatial/psychcmotor  oerposite 

•71 

ABLE 

.58 

Tiracking  test 

.44 

I-COFT  tradning  score 

.44 

These  data  further  show  that  the  soldieirs  selected  for  EIA  differ  froti 
those  not  selected  cn  the  S^  test  dimensions  as  well  as  GT.  The  canonical 
correlation  indicates,  however,  that  only  6%  of  the  variance  is  accounted  for 
by  these  variables.  The  lew  oorrelaticai  could  be  due  to  several  factors.  EIA 
selection  could  be  based  on  some  set  of  dimensions  other  than  psychaiotor, 
leadership,  and  mental  ability.  Or,  the  intent  of  the  selection  process  could 
be  to  select  on  these  dimensions,  but  not  be  very  efficient.  It  is  likely  a 
cerbination  of  the  two.  Including  test  information  into  the  selection 
procedures  would  increase  the  efficiency  of  the  process  for  selecting  cn  these 
dimensions.  Furthemore,  explicitly  using  I-COFT  training  perfonrance  data 
would  help  select  soldiers  with  better  gunnery  aptitudes.  Notice  in  Table  10 
that  I-COPT  training  performance  was  least  correlated  with  the  EIA  selection 
discriminant  function. 

CompBirison  of  EIA  Qraduates  and  Non-graduates 

Approximately  20%  of  the  soldiers  selected  for  the  EIA  program  fail  to 
ccrplete  the  accelerated  program.  If  the  tests  could  additionally  predict 
those  soldiers  who  are  likely  to  attrit  from  the  program,  the  test  utility 
would  be  greatly  enhanced.  Table  11  compares  the  s3  and  GT  scores  of  soldiers 
selected  for  EIA  who  graduate  to  those  selected  who  do  not  graduate. 
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T&ble  11 


S3  arid  GT  Scores  of  Sbldiers  Selected  for  EIA  Who  Graduate  and 
Who  Do  Not  Graduate 


Test 

Scores 

Selected  and 

Not  Graduated 
(n=53) 

Selected  and 
Giraduated 
(rt=129) 

t(180)= 

Spatial  test 

34.9 

34.2 

-.57 

Tracking  test 

56.7 

56.9 

.20 

Spatial/psychomotor  ooiposite 

72.9 

72.0 

-.29 

ABLE 

67.3 

68.3 

.25 

GT 

107.7 

110.0 

1.19 

None  of  the  differences  are 

significant,  vhich 

suggests  that 

success  for 

those  selected  into  the  EIA  program  is  a  function  of  factors  other  than 
psychcmotor,  leadership,  or  mental  ability.  Discussions  vdth  lATB  personnel 
have  indicated  that  many  of  the  soldiers  v»ho  fail  to  graduate  fixni  the  EIA 
program  do  so  because  they  can  not  meet  the  program’s  rigorous  fiiysical 
training  (PT)  standards.  The  soldiers  fail  to  graduate  frcin  EIA  do, 
however,  graduate  frxan  the  OSUT  program. 

s3  cverlap  with  Current  EIA  Selection 

As  shown  earlier,  soldiers  currently  selected  for  the  EIA  pogram  score 
higher  on  the  s3  tests  than  those  soldiers  not  selected.  It  nay  be  that  the 
11%  of  the  soldiers  are  selected  for  EIA  are  also  the  tcp  scorers  on  the 
s3  tests,  'feble  12  shews  the  percentage  of  soldiers  currently  selected  for 
EIA  that  would  be  included  in  the  sample  of  soldiers  selected  based  on  veirious 
s3  cuts.  The  percentile  cuts  used  an  equal  weighting  of  ABLE  and  the 
spatial /psychcmotor  cerposite.  The  table  shows,  for  example,  if  an  s3  cut 
score  was  selected  to  include  the  upper  30%  of  OSUT  soldiers  based  on  the  s3 
test,  48%  of  the  current  EIA  soldiers  would  be  above  that  cut. 

These  results  indicate  a  moderate  overlap  in  the  results  of  the  current 
selection  process  and  the  s3  tests.  As  shewn  in  the  discriminant  analysis, 
the  current  EIA  selection  procedure  is  not  maximizing  the  selection  of 
soldiers  on  the  basis  of  psychcmotor  and  leadership  abilities,  at  leeist  as 
measured  by  the  s3  tests.  Qigoing  research  at  the  ARE  Ftort  Knox  Field  Unit  is 
monitoring  the  EIA  selection  process  with  the  goal  being  to  determine  those 
characteristics  that  are  being  used  for  selection. 


16 


Table  12 


Percent  of  Current  EIA  Above  and  Below  Various  Cuts 


S3  Cuts 

Percent  of  Current 

EIA  Above  Cut 

Percent  of  Current 

EIA  Below  Cut 

Upper  20% 

34% 

66% 

30% 

48% 

52% 

40% 

61% 

39% 

50% 

74% 

26% 

70% 

89% 

11% 

90% 

96% 

4% 

A  final  analysis  examined  the  results  on  I-COFT  performance  after  combin¬ 
ing  the  current  selection  procedures  with  S3  cut  scores.  Table  13  shows  the 
I-COFT  speed/accuracy  composite  scores  using  current  selection  procedures, 
using  a  30%  cut  score,  and  the  cross  between  the  two  procedures. 

Table  13 

I-COFT  Speed/Accuracy  Scores  Using  Current  and  Selection  Procedures 


Current  EIA  Selection  Procedures 
Not 

Selected  Selected 


These  results  shew  that  the  soldiers  vho  were  selected  for  EIA  and  vsho 
cdso  were  in  the  i;pper  30%  on  the  s3  tests  performed  best  cn  the  I-COFT  test. 
These  data  replicate  the  findings  of  Cast  (1988)  in  shewing  that  the  current 
EIA  soldiers  vho  score  high  cn  the  tests  are  the  "cream  of  the  crop." 

Discussion 

The  results  clearly  denonstrate  that  the  s3  spatial  and  psychatDtor  tests 
are  valid  predictors  of  tank  gunnery  performance  as  measured  on  the  I-C30FT. 

Not  cnly  were  the  oorrelatic»is  relatively  high,  but  the  2  1/2  month  interval 
between  the  predictor  emd  criterion  tests  suggests  the  relationship  should 
remain  stable  over  an  extended  period  of  time.  Furthermore,  the  strength  of 
the  relationship  shrunk  only  slightly  when  the  EIA  soldiers  were  givei  a 
considerable  amount  of  additicxial  txeiining.  T&ken  together  the  data  shew  the 
tests  to  be  valid  over  time  and  varying  levels  of  gunnery  proficiency. 

The  conparisen  of  soldiers  selected  for  EIA  to  those  not  selected  foiand 
the  EIA  soldiers  to  have  better  spatial,  psychemotor,  and  leadership  skills 
than  those  not  selected.  The  EIA  soldiers  also  had  higher  GT  scores  and 
performed  better  on  the  I-CXFT  criterion  test.  The  analyses  indicated, 
however,  that  including  the  S3  test  scores  in  the  EIA  selecticai  process  would 
result  in  EIA  soldiers  with  stronger  gunnery  skills.  The  analyses  also 
shewed  that  I-OOFT  training  performance  data  were  not  effectively  used  in  the 
selection  process.  Modifications  to  the  OSUT  training  schedule  might  have  to 
be  made  in  order  to  use  the  I-OOFT  training  performance  information. 

The  goal  of  the  EIA  program  is  to  train  leaders,  in  addition  to  strong 
gunnery  ^ills.  Tb  help  meet  this  goal,  the  s3  test  included  ABLE  vhich 
previously  has  been  shewn  to  predict  leader  potential.  It  was  thought  that 
ABLE  might  predict  attrition  form  the  EIA  program,  but  this  result  was  not 
found.  Other  than  the  attrition  einalyses,  the  research  design  did  not  test 
the  validity  of  ABLE  as  a  predictor  of  soft,  leadership- type,  skills. 

The  current  EIA  selection  procedure  relies  heavily  on  supervisory  evalua¬ 
tions  which  are  believed  to  be  good  measures  of  soldier  motivation  and  leader 
potential.  Subjective  appraisals  are  a  necessary  part  of  the  EIA  selection 
process,  but  the  analyses  suggest  there  is  room  for  improvement.  Less  than 
five  percent  of  the  variance  discriminating  EIA  soldier  selection  was  ac¬ 
counted  for  by  the  s3  tests,  GT  scores,  and  I-COFT  treiining  perfomence  data. 
Given  that  the  tests  measure  psychemotor,  spatial,  leadership,  and  mental 
abilities,  plus  hands-on  I-COFT  training  performance,  one  would  ea^aect  a 
greater  difference  between  EIA  and  normal  track  soldiers  in  these  important 
cireas. 

Reports  from  the  field  indicate  EIA  graduates  are  superior  to  other  OSUT 
soldiers.  Likewise,  Mendel  eind  Erffineyer  (1988)  have  shewn  that  EIA  soldiers 
perform  at  or  above  normal  track  soldiers  in  all  areas  of  responsibility.  The 
s3  research  reported  here  was  ocnducted  as  part  of  an  effort  to  improve  what 
is  linguestionably  an  already  successfvil  program.  The  critical  questicxi 
concerning  the  utility  of  the  S3  tests  as  an  EIA  selection  tool  remains 
unanswered.  Vtould  the  overall  quality  of  EIA  graduates  be  higher  if  certain 
soldiers  selected  for  the  accelerated  training  program,  i.e.,  those  who  scored 


low  on  the  tests,  were  replaced  by  soldiers  vho  scored  high.  Ihe  data 
suggest  that  the  overall  quality  of  the  EIA  graduates  would  increeise  if  the 
s3  tests  were  included  in  the  EIA  selection  process.  The  result  would  be  EIA 
soldiers  with  stronger  leadership  and  warfighting  abilities. 
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